RE-AIM for rural health innovations: perceptions of (mis) alignment between the RE-AIM framework and evaluation reporting in the Department of Veterans Affairs Enterprise-Wide Initiatives program.

Background: The Department of Veterans Affairs (VA) Office of Rural Health (ORH) supports national VA program offices' efforts to expand health care to rural Veterans through its Enterprise-Wide Initiatives (EWIs) program. In 2017, ORH selected Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM), an implementation science framework, to structure the EWI evaluation and reporting process. As part of its mandate to improve EWI program evaluation, the Center for the Evaluation of Enterprise-Wide Initiatives conducted a qualitative evaluation to better understand EWI team' perceptions of, and barriers and facilitators to, the EWI evaluation process. Methods: We conducted 43 semi-structured interviews with 48 team members (e.g., evaluators, program office leads, and field-based leads) representing 21 EWIs from April-December 2020. Questions focused on participants' experiences using strategies targeting each RE-AIM dimension. Interviews were inductively analyzed in MAXQDA. We also systematically reviewed 51 FY19-FY20 EWI annual reports to identify trends in misapplications of RE-AIM. Results: Participants had differing levels of experience with RE-AIM. While participants understood ORH's rationale for selecting a common framework to structure evaluations, the perceived misalignment between RE-AIM and EWIs' work emerged as an important theme. Concerns centered around 3 sub-themes: (1) (Mis)Alignment with RE-AIM Dimensions, (2) (Mis)Alignment between RE-AIM and the EWI, and (3) (Mis)Alignment with RE-AIM vs. other Theories, Models, or Frameworks. Participants described challenges differentiating between and operationalizing dimensions in unique contexts. Participants also had misconceptions about RE-AIM and its relevance to their work, e.g., that it was meant for established programs and did not capture aspects of initiative planning, adaptations, or sustainability. Less commonly, participants shared alternative models or frameworks to RE-AIM. Despite criticisms, many participants found RE-AIM useful, cited training as important to understanding its application, and identified additional training as a future need. Discussion: The selection of a shared implementation science framework can be beneficial, but also challenging when applied to diverse initiatives or contexts. Our findings suggest that establishing a common understanding, operationalizing framework dimensions for specific programs, and assessing training needs may better equip partners to integrate a shared framework into their evaluations.

The Effects of a Single-Session Virtual Rumination Intervention to Enhance Cognitive Functioning in Veterans With Subjective Cognitive Symptoms: Multimethod Pilot Study.

BACKGROUND: Subjective cognitive concerns (SCCs) entail perceived difficulties in thinking or memory, often reported without substantial objective evidence of cognitive impairment. These concerns are prevalent among individuals with a history of brain injuries, neurological conditions, or chronic illnesses, contributing to both psychological distress and functional limitations. They are increasingly considered to be a risk factor for future objective decline. A considerable number of individuals reporting SCCs also exhibit mental health symptoms, such as a history of trauma, depression, or anxiety. Interventions that address modifiable emotional and cognitive factors related to SCC could improve functioning and quality of life. Therefore, the use of emotion regulation strategies, especially those directed at minimizing rumination, could serve as a promising focus for interventions aimed at mitigating subjective cognitive concerns in veteran populations. OBJECTIVE: This pilot study explored the feasibility, acceptability, and preliminary efficacy of a brief, 1-session emotion regulation intervention called "Worry Less, Remember More." The Worry Less, Remember More intervention was designed to reduce rumination and improve subjective cognitive functioning in veterans with subjective cognitive changes (N=15). METHODS: We randomized 15 veterans to either the active telehealth condition or waitlist control and completed the intervention. Participants were aged between 31 and 67 (mean 49.5, SD 10.1) years, and the sample was primarily male (12/15, 83%) and White (10/15, 67%). The most common diagnoses were posttraumatic stress disorder and depression. Following the intervention, veteran input was sought through semistructured interviews with a subset of 12 participants, examining feasibility, acceptability, and perceived efficacy. Preliminary efficacy was also measured using pre- and postintervention self-report measures. RESULTS: Veterans reported that this intervention was acceptable, with 92% (11/12) of the sample reporting that they benefited from the intervention and would recommend the intervention to others with similar difficulties. Semistructured interviews revealed difficulties with feasibility, including problems with the remote consenting process, forgetting appointments, and needing additional strategies to remember to consistently use the interventions. The intervention improved self-reported cognitive symptoms on quantitative measures but did not improve self-reported rumination. CONCLUSIONS: This pilot study establishes the preliminary feasibility, acceptability, and efficacy of the Worry Less, Remember More intervention for veterans with subjective cognitive symptoms. Future iterations of the intervention may benefit from simplifying the electronic consent process, providing reminders for appointments, and incorporating compensatory cognitive strategies to assist with using the telehealth system, as well as applying the strategies learned in the intervention. While future research is needed with larger samples, including nonveteran populations, the intervention may also be a useful clinical tool to bridge care between neuropsychology clinics and mental health treatment.

An implementation strategy postmortem method developed in the VA rural Transitions Nurse Program to inform spread and scale-up.

BACKGROUND: High-quality implementation evaluations report on intervention fidelity and adaptations made, but a practical process for evaluating implementation strategies is needed. A retrospective method for evaluating implementation strategies is also required as prospective methods can be resource intensive. This study aimed to establish an implementation strategy postmortem method to identify the implementation strategies used, when, and their perceived importance. We used the rural Transitions Nurse Program (TNP) as a case study, a national care coordination intervention implemented at 11 hospitals over three years. METHODS: The postmortem used a retrospective, mixed method, phased approach. Implementation team and front-line staff characterized the implementation strategies used, their timing, frequency, ease of use, and their importance to implementation success. The Expert Recommendations for Implementing Change (ERIC) compilation, the Quality Enhancement Research Initiative phases, and Proctor and colleagues' guidance were used to operationalize the strategies. Survey data were analyzed descriptively, and qualitative data were analyzed using matrix content analysis. RESULTS: The postmortem method identified 45 of 73 ERIC strategies introduced, including 41 during pre-implementation, 37 during implementation, and 27 during sustainment. External facilitation, centralized technical assistance, and clinical supervision were ranked as the most important and frequently used strategies. Implementation strategies were more intensively applied in the beginning of the study and tapered over time. CONCLUSIONS: The postmortem method identified that more strategies were used in TNP than planned and identified the most important strategies from the perspective of the implementation team and front-line staff. The findings can inform other implementation studies as well as dissemination of the TNP intervention.

Adaptation of the brainwriting premortem technique to inform the co-creation of COVID-19 testing strategies in underserved communities in South San Diego.

INTRODUCTION: Meaningful engagement of partners in co-creating and refining health-related programs can increase the initial uptake, sustained implementation, broad reach, and effectiveness of these programs. This is especially important for underserved communities where resources are limited and need to be prioritized. Brainwriting premortem is a novel qualitative approach to partner engagement that combines the strengths of individual idea generation with the concept of premortem exercise that addresses failure points prior to the implementation of new programs. METHODS: An adapted form of brainwriting premortem was used to inform iterative refinements to a COVID-19 testing program at a Federally Qualified Health Center (FQHC) in San Diego. Patients and providers from the FQHC participated in interviews at two time points (early- and mid-implementation of the program). Interview data were transcribed, translated, and analyzed using a rapid qualitative approach. Key themes and sub-themes were identified and used to inform refinements to the program. RESULTS: A total of 11 patients (7 Spanish- and 4 English-speaking) and 8 providers participated in the brainwriting premortem interviews. Key themes related to possible reasons for COVID-19 testing program failure: advertising/sharing information; access to testing; handling of test results; staff and patient safety; patient beliefs and views regarding the SARS-CoV-2 virus; and COVID-19 testing options offered. Proposed solutions were offered for the key failures except for patient beliefs and views regarding the SARS-CoV-2 virus. Additional solutions offered were related to education, physical operations, and recruitment strategies. Real-time changes to the program flow and components were made in response to 7 suggestions from patients and 11 from providers. Changes related to the process of returning results were the most common, and included sending results via email with distinct workflows based on the test result. CONCLUSION: The implementation of the adapted brainwriting premortem technique allowed us to incorporate the perspective of key partners in the delivery and iterative refinement of the COVID-19 testing program. This was an effective tool in the context of an FQHC and can be a promising and approach to incorporate iterative input from patients and providers to ensure successful program implementation. Future studies, particularly those requiring rapid response to public health emergencies, should consider the use of this technique.

Community-engaged optimization of COVID-19 rapid evaluation and testing experiences: roll-out implementation optimization trial.

BACKGROUND: There continues to be a need for COVID-19 testing that is pragmatic, community-centered, and sustainable. This study will refine and test implementation strategies prioritized by community partners: (1) walk-up no-cost testing, (2) community health worker (promotores)-facilitated testing and preventive care counseling, (3) vending machines that dispense no-cost, self-testing kits. METHODS: A co-designed Theory of Change from an earlier study phase and the Practical, Robust Implementation and Sustainment Model (PRISM) will guide the study design, measures selection, and evaluation. The first aim is to refine and operationalize a multi-component implementation strategy bundle and outcome measures for COVID-19 testing. A Community and Scientific Advisory Board (CSAB) will be established and include community members, clinical providers/staff from the partnering Federally Qualified Health Center (FQHC), public health researchers, policymakers, and a county health department ambassador. Engagement of CSAB members will be assessed through structured ethnography and a survey about the quality and quantity of engagement practices. The second aim is to implement and evaluate the impact of the implementation strategy bundle to optimize COVID-19 testing in communities using a roll-out implementation optimization (ROIO) design. Seven thousand and five hundred community members will be enrolled across four FQHC clinics over 18 months. Participants will be invited to complete an electronic survey about their demographics, health, and COVID-19 testing results and experiences. CSAB members and clinic partners will participate in PRISM fit and determinant assessments prior to each clinic rollout and post-trial. Interviews will be conducted with 60 community participants and 12 providers/staff following a 3-month rollout period at each clinic, inquiring about their experiences with the implementation strategies. Quantitative data will be analyzed using hierarchical multilevel models to determine the impact of implementation strategies. Qualitative data will be analyzed using rapid qualitative approaches to summarize implementation experiences and identify necessary changes prior to subsequent rollouts. A matrix approach will be used to triangulate data from quantitative and qualitative sources based on PRISM domains. DISCUSSION: This is one of the first pragmatic implementation trials to use a ROIO design and aims to co-create a sustainable and equitable COVID-19 testing program. Findings are likely to generalize to other public health prevention efforts. TRIAL REGISTRATION: NCT05894655 March 2, 2023.

Process evaluation of an academic dissemination and implementation science capacity building program.

The UC San Diego Altman Clinical and Translational Research Institute Dissemination and Implementation Science Center (DISC) launched in 2020 to provide dissemination and implementation science (DIS) training, technical assistance, community engagement, and research advancement. DISC developed a program-wide logic model to inform a process evaluation of member engagement and impact related to DISC services. The DISC Logic Model (DLM) served as the framework for a process evaluation capturing quantitative and qualitative information about scientific activities, outputs, and outcomes. The evaluation involved a multimethod approach with surveys, attendance tracking, feedback forms, documentation of grant outcomes, and promotions metrics (e.g., Twitter engagement). There were 540 DISC Members at the end of year 2 of the DISC. Engagement in the DISC was high with nearly all members endorsing at least one scientific activity. Technical assistance offerings such as DISC Journal Club and consultation were most frequently used. The most common scientific outputs were grant submission (65, 39%), formal mentoring for career award (40, 24%), and paper submission (34, 21%). The DLM facilitated a comprehensive process evaluation of our center. Actionable steps include prioritizing technical assistance, strengthening networking opportunities, identifying streamlined approaches to facilitate DIS grant writing through writing workshops, as well as "office hours" or organized writing leagues.

Hub-and-Spoke centralized intervention to optimize colorectal cancer screening and follow-up: A pragmatic, cluster-randomized controlled trial protocol.

BACKGROUND: Guidelines recommend screening for colorectal cancer (CRC), but participation and abnormal test follow up rates are suboptimal, with disparities by demography. Evidence-based interventions exist to promote screening, but community adoption and implementation are limited. METHODS: The San Diego Accelerating Colorectal Cancer Screening and Follow-up through Implementation Science (ACCSIS) program is an academic-community partnership testing regional implementation of a Hub-and-Spoke model for increasing CRC screening and follow-up. The "hub" is a non-academic, non-profit organization that includes 17 community health center (CHC) systems, serving over 190 rural and urban clinic sites. The "spokes" are 3 CHC systems that oversee 11-28 clinics each, totaling over 60 clinics. Using a cluster-randomized trial design, 9 clinics were randomized to intervention and 16 to usual care. Within intervention clinics, approximately 5000 eligible patients not up-to-date with CRC screening per year were identified for intervention. Interventions include an invitation primer, a mailed fecal immunochemical test with completion instructions, and phone and text-based reminders (hub) and patient navigation protocol to promote colonoscopy completion after abnormal FIT (spoke). Outcomes include: 1) proportion of patients up-to-date with screening after three years in intervention versus non-intervention clinics; 2) proportion of patients with abnormal FIT completing colonoscopy within six months of the abnormal result. Implementation science measures are collected to assess acceptability, intervention and usual care adaptations, and sustainability of the intervention strategies. CONCLUSION: This large-scale, regional cluster randomized trial among CHCs serving diverse populations is anticipated to accelerate progress in CRC prevention in underserved populations. TRIAL REGISTRATION: NCT04941300.

The iPRISM webtool: an interactive tool to pragmatically guide the iterative use of the Practical, Robust Implementation and Sustainability Model in public health and clinical settings.

BACKGROUND: To increase uptake of implementation science (IS) methods by researchers and implementers, many have called for ways to make it more accessible and intuitive. The purpose of this paper is to describe the iPRISM webtool (Iterative, Practical, Robust Implementation and Sustainability Model) and how this interactive tool operationalizes PRISM to assess and guide a program's (a) alignment with context, (b) progress on pragmatic outcomes, (c) potential adaptations, and (d) future sustainability across the stages of the implementation lifecycle. METHODS: We used an iterative human-centered design process to develop the iPRISM webtool. RESULTS: We conducted user-testing with 28 potential individual and team-based users who were English and Spanish speaking from diverse settings in various stages of implementing different types of programs. Users provided input on all aspects of the webtool including its purpose, content, assessment items, visual feedback displays, navigation, and potential application. Participants generally expressed interest in using the webtool and high likelihood of recommending it to others. The iPRISM webtool guides English and Spanish-speaking users through the process of iteratively applying PRISM across the lifecycle of a program to facilitate systematic assessment and alignment with context. The webtool summarizes assessment responses in graphical and tabular displays and then guides users to develop feasible and impactful adaptations and corresponding action plans. Equity considerations are integrated throughout. CONCLUSIONS: The iPRISM webtool can intuitively guide individuals and teams from diverse settings through the process of using IS methods to iteratively assess and adapt different types of programs to align with the context across the implementation lifecycle. Future research and application will continue to develop and evaluate this IS resource.

Factors associated with COVID-19 vaccine uptake in a US/Mexico border community: demographics, previous influenza vaccination, and trusted sources of health information.

Background: COVID-19 vaccine uptake has been uneven, particularly across racial/ethnic and age groups. This study seeks to understand factors associated with COVID-19 vaccine uptake in a large cross-sectional sample of predominantly Latinos/Latinas individuals living near the US/Mexico border. Methods: Data are extracted from a 176-item survey conducted as part of a parent study focused on the co-creation of a COVID-19 testing program for underserved communities developed through a partnership between an academic institution and a Federally Qualified Health Center. The following participant variables were examined: health history, COVID-19 symptoms, COVID-19 testing and vaccine experiences, and perceptions of sources of health information. Participant characteristics were compared using chi-square tests. Multivariate logistic regressions were used for the final statistical model. Results: From 1 May 2021 to 30 April 2022, 4,964 adults, 66% of whom were identified as women, completed the survey. Approximately 80% of participants reported having received at least one COVID-19 vaccine. Female sex, older age, Hispanic/Latino(a) ethnicity, previous influenza vaccination, advanced education, and perceived elevated risk of COVID-19 were significantly (p < 0.05) associated with having received a COVID-19 vaccine. Regarding sources of health information, individuals who indicated they trust their doctor, healthcare provider, or the US government "a great deal" were more likely to have received a COVID-19 vaccine compared to individuals who indicated that they trusted these sources "not at all." In contrast, those who reported having "a great deal" of trust in their faith leader or their social media contacts were significantly less likely to have received a COVID-19 vaccine than those who reported that they trusted these sources "not at all." Conclusion: Sex, education, past influenza vaccination, perceived risk of COVID-19 infection, and trust in specific sources of information were correlated with the uptake of COVID-19 vaccination. Additional research is needed to better understand why this confluence of factors, particularly the unique findings about trusted sources of information, are associated with vaccine uptake. Understanding these associations, specifically within underserved, Latino/Hispanic communities, is an important first step to inform efforts aimed at increasing and sustaining COVID-19 vaccine uptake and adoption of other public health interventions.

Understanding feasibility and acceptability of implementation of linking delivery of family planning and infant vaccination care in rural Maharashtra, India: a qualitative study.

BACKGROUND: Linking family planning with infant vaccination care has the potential to increase contraceptive use among postpartum women in rural settings. We explored the multilevel factors that can facilitate or impede uptake of contraception at the time of infant vaccination among postpartum women and couples in rural Maharashtra, India. METHODS: We conducted 60 semi-structured interviews with key stakeholders including: postpartum married women (n = 20), husbands (n = 10), and mothers-in-law (n = 10) of postpartum women, frontline healthcare workers (auxiliary nurse midwives (ANMs) and Accredited Social Health Activists (ASHAs), (n = 10), and community leaders (physician medical officers and village panchayat leaders) (n = 10). We sought to assess the feasibility and acceptability of delivering community-based postpartum family planning care in rural India at the time of infant vaccination. The Consolidated Framework for Implementation Research (CFIR) was used to design a structured interview guide and codebook. Data were analyzed via directed content analysis. RESULTS: Three major themes emerged: (1) Social fertility and gender norms including son preference and male control over contraceptive decision-making influence postpartum contraceptive access and choice. (2) Linking contraceptive care and infant vaccination is perceived as potentially feasible and acceptable to implement by families, health workers, and community leaders. The intervention provides care to women and families in a convenient way where they are in their community. (3) Barriers and facilitators to linked infant postpartum contraception and infant vaccination were identified across the five CFIR domains. Key barriers included limited staff and space (inner setting), and contraceptive method targets for clinics and financial incentives for clinicians who provide specific methods (outer setting). Key facilitators included convenience of timing and location for families (intervention characteristics), the opportunity to engage husbands in decision-making when they attend infant vaccination visits (participant characteristics), and programmatic support from governmental and community leaders (process of implementation). CONCLUSIONS: Linked provision of family planning and infant vaccination care may be feasible and accessible in rural India utilizing strategies identified to reduce barriers and facilitate provision of care. A gender-transformative intervention that addresses gender and social norms has greater potential to impact reproductive autonomy and couples' contraceptive decision-making.

Scaling and sustaining COVID-19 vaccination through meaningful community engagement and care coordination for underserved communities: hybrid type 3 effectiveness-implementation sequential multiple assignment randomized trial.

BACKGROUND: COVID-19 inequities are abundant in low-income communities of color. Addressing COVID-19 vaccine hesitancy to promote equitable and sustained vaccination for underserved communities requires a multi-level, scalable, and sustainable approach. It is also essential that efforts acknowledge the broader healthcare needs of these communities including engagement in preventive services. METHODS: This is a hybrid type 3 effectiveness-implementation study that will include a multi-level, longitudinal, mixed-methods data collection approach designed to assess the sustained impact of a co-created multicomponent strategy relying on bidirectional learning, shared decision-making, and expertise by all team members. The study capitalizes on a combination of implementation strategies including mHealth outreach with culturally appropriate messaging, care coordination to increase engagement in high priority preventive services, and the co-design of these strategies using community advisory boards led by Community Weavers. Community Weavers are individuals with lived experience as members of an underserved community serving as cultural brokers between communities, public health systems, and researchers to co-create community-driven, culturally sensitive public health solutions. The study will use an adaptive implementation approach operationalized in a sequential multiple assignment randomized trial design of 300 participants from three sites in a Federally Qualified Health Center in Southern California. This design will allow examining the impact of various implementation strategy components and deliver more intensive support to those who benefit from it most. The primary effectiveness outcomes are COVID-19 vaccine completion, engagement in preventive services, and vaccine confidence. The primary implementation outcomes are reach, adoption, implementation, and maintenance of the multicomponent strategy over a 12-month follow-up period. Mixed-effects logistic regression models will be used to examine program impacts and will be triangulated with qualitative data from participants and implementers. DISCUSSION: This study capitalizes on community engagement, implementation science, health equity and communication, infectious disease, and public health perspectives to co-create a multicomponent strategy to promote the uptake of COVID-19 vaccination and preventive services for underserved communities in San Diego. The study design emphasizes broad engagement of our community and clinic partners leading to culturally sensitive and acceptable strategies to produce lasting and sustainable increases in vaccine equity and preventive services engagement. TRIAL REGISTRATION: ClinicalTrials.gov Identifier: NCT05841810 May 3, 2023.

Insights from Immigrant and Refugee Communities Regarding COVID-19 Needs and Opportunities: A Mixed Methods Study.

Introduction: : This mixed methods study describes processes to actively engage underserved, immigrant, and refugee communities in COVID-19 vaccine efforts to co-create culturally relevant resources and dissemination. Methods: : A survey on health care characteristics and COVID-19 attitudes was deployed between March-November 2021 followed by listening sessions conducted in December 2021. All participants were recruited through the project's Community Advisory Board. The survey, completed by 77 adults, was available in English, Spanish, Burmese, Kizigua, and Karen. Listening sessions were led by trained, multilingual, and multicultural interviewers. Results: : Doctors/healthcare providers were rated as the most trusted messengers of COVID-19 information, however, trusted sources varied across communities. Data from three listening sessions (with a total of 14 participants) expanded survey findings with a focus on trusted sources of COVID-19 communication. Conclusions: : This study confirmed the importance of healthcare professionals as trusted messengers for COVID-19 information among underserved communities. Qualitative data highlighted the importance of schools, ethnically-based community organizations, and friends/family with health and English literacy skills for immigrant and refugee communities. Findings suggest opportunities for collaboration with specific trusted sources for future public health dissemination efforts. Trial registration: : not applicable.

A qualitative analysis of pharmacists' attitudes towards provision of medication abortion.

BACKGROUND: 90% of United States' counties do not have a single clinic offering abortion care, and barriers to care disproportionately affect low-income families. Novel models of abortion care delivery, including provision of medication abortion in pharmacies, with pharmacists prescribing medication, have the potential to expand access to abortion care. Pharmacists are well-positioned to independently provide abortion care and are highly accessible to patients, however medication abortion provision by pharmacists is not currently legal or available in the United States. To assess the potential acceptability of pharmacist provision of medication abortion and to identify anticipated barriers and facilitators to this model of care, we explored pharmacists' attitudes towards providing medication abortion, inclusive of patient selection, counseling, and medication prescribing. METHODS: From May to October 2021, we conducted 20 semi-structured qualitative interviews with pharmacists across the United States, guided by the domains of the Consolidated Framework for Implementation Science Research. RESULTS: Major themes included there is a need for pharmacist provision of medication abortion and pharmacists perceive provision of medication abortion to be potentially acceptable if anticipated barriers are addressed. Anticipated barriers identified included personal, religious, and political beliefs of pharmacists and lack of space and systems to support the model. Ensuring adequate staffing with pharmacists willing to participate, private space, time for counseling, safe follow-up, training, and reimbursement mechanisms were perceived strategies to facilitate successful implementation. CONCLUSIONS: Pharmacist identified implementation strategies are needed to reduce anticipated barriers to pharmacist provision of medication abortion.

Cost effectiveness of a technology-enhanced physical activity intervention for Latinas.

Latinas report low levels of physical activity (PA) and disproportionate risk of lifestyle-related diseases. Enhancements to evidence-based PA interventions may increase efficacy; however, uptake of interventions will likely depend on costs. To describe costs and examine the cost-effectiveness of two interventions for helping Latinas reach national aerobic PA guidelines. Adult Latinas (N = 199) were randomly assigned to an Original theory-based mail-delivered intervention or an Enhanced version with texting and additional calls and materials. Meeting PA guidelines was measured by the 7-Day PA Recall interview at baseline, 6 and 12 months. Intervention costs were estimated from a payer perspective. Incremental cost-effectiveness ratios (ICERs) were calculated as the additional cost per participant meeting guidelines in the Enhanced versus Original intervention. At baseline, no participants met guidelines. After 6 months, 57% and 44% in the Enhanced and Original arms met guidelines, respectively; at 12 months, rates fell to 46% and 36%. Cost per person of the Enhanced and Original interventions were $184 and $173 at 6 months, respectively, and $234 and $203 at 12 months. The primary additional expense in the Enhanced arm was staff time. ICERs were $87 per additional person meeting guidelines at 6 months (per sensitivity analysis, $26 if delivered by volunteers and $114 by medical assistants), and $317 at 12 months (sensitivity analysis: $57 and $434). Incremental costs per person meeting guidelines in the Enhanced arm were modest and could be warranted given the potential health benefits of meeting PA guidelines.

Latinas report low levels of physical activity (PA) and high rates of related diseases. Existing evidence-based interventions for Latinas may need additional enhancements to help this population meet national PA guidelines. Enhancements could both increase the effectiveness and the costs of PA interventions. It is thus important to consider the costs and benefits of the different versions of these interventions, as these may influence whether the interventions are adopted and sustained on a larger scale in the future. This study describes the costs of two versions of a PA intervention (an original and a technology-enhanced version) and examines their cost effectiveness in helping sedentary Latina participants reach national PA guidelines. At the beginning of the study, none of the participants were meeting PA guidelines. More participants in the Enhanced intervention, compared to the Original intervention, were meeting guidelines both at 6 months (57% vs. 44%) and 12 months (46% vs. 36%). Costs were also higher for the Enhanced Intervention both at 6 and 12 months. Each additional person meeting guidelines in the Enhanced (vs. Original) group cost $87 at 6 months and $317 at 12 months. Given potential cost savings in medical care associated with meeting PA guidelines, these interventions could ultimately save money in addition to promoting health.

Using ethnographic approaches to document, evaluate, and facilitate virtual community-engaged implementation research.

BACKGROUND: Community Advisory Boards (CABs) have been frequently used to engage diverse partners to inform research projects. Yet, evaluating the quality of engagement has not been routine. We describe a multi-method ethnographic approach documenting and assessing partner engagement in two "virtual" CABs, for which we conducted all meetings remotely. METHODS: Two research projects for increasing equitable COVID-19 testing, vaccination, and clinical trial participation for underserved communities involved remote CAB meetings. Thirty-three partners representing 17 community groups participated in 15 sessions across the two CABs facilitated by a social change organization. We developed ethnographic documentation forms to assess multiple aspects of CAB member engagement (e.g., time spent speaking, modality used, types of interactions). Documenters were trained to observe CAB sub-groups via virtual sessions. Debriefing with the documentation team after CAB meetings supported quality assurance and process refinement. CAB members completed a brief validated survey after each meeting to assess the quality and frequency of engagement. Content and rapid thematic analysis were used to analyze documentation data. Quantitative data were summarized as frequencies and means. Qualitative and quantitative findings were triangulated. RESULTS: A total of 4,540 interactions were identified across 15 meetings. The most frequent interaction was providing information (44%), followed by responding (37-38%). The quality and frequency of stakeholder engagement were rated favorably (average 4.7 of 5). Most CAB members (96%) reported good/excellent engagement. Specific comments included appreciation for the diversity of perspectives represented by the CAB members and suggestions for improved live interpretation. Debriefing sessions led to several methodological refinements for the documentation process and forms. CONCLUSION: We highlight key strategies for documenting and assessing community engagement. Our methods allowed for rich ethnographic data collection that refined our work with community partners. We recommend ongoing trainings, including debriefing sessions and routinely reviewed assessment of data to strengthen meaningful community engagement.

A systematic review of dissemination and implementation science capacity building programs around the globe.

BACKGROUND: Research centers and programs focused on dissemination and implementation science (DIS) training, mentorship, and capacity building have proliferated in recent years. There has yet to be a comprehensive inventory of DIS capacity building program (CBP) cataloging information about activities, infrastructure, and priorities as well as opportunities for shared resources, collaboration, and growth. The purpose of this systematic review is to provide the first inventory of DIS CBPs and describe their key features and offerings. METHODS: We defined DIS CBPs as organizations or groups with an explicit focus on building practical knowledge and skills to conduct DIS for health promotion. CBPs were included if they had at least one capacity building activity other than educational coursework or training alone. A multi-method strategy was used to identify DIS CBPs. Data about the characteristics of DIS CBPs were abstracted from each program's website. In addition, a survey instrument was developed and fielded to gather in-depth information about the structure, activities, and resources of each CBP. RESULTS: In total, 165 DIS CBPs met our inclusion criteria and were included in the final CBP inventory. Of these, 68% are affiliated with a United States (US) institution and 32% are internationally based. There was one CBP identified in a low- and middle-income country (LMIC). Of the US-affiliated CBPs, 55% are embedded within a Clinical and Translational Science Award program. Eighty-seven CBPs (53%) responded to a follow-up survey. Of those who completed a survey, the majority used multiple DIS capacity building activities with the most popular being Training and Education (n=69, 79%) followed by Mentorship (n=58, 67%), provision of DIS Resources and Tools (n=57, 66%), Consultation (n=58, 67%), Professional Networking (n=54, 62%), Technical Assistance (n=46, 52%), and Grant Development Support (n=45, 52%). CONCLUSIONS: To our knowledge, this is the first study to catalog DIS programs and synthesize learnings into a set of priorities and sustainment strategies to support DIS capacity building efforts. There is a need for formal certification, accessible options for learners in LMICs, opportunities for practitioners, and opportunities for mid/later stage researchers. Similarly, harmonized measures of reporting and evaluation would facilitate targeted cross-program comparison and collaboration.

Perceived COVID-19 risk and testing experiences in the San Ysidro U.S./Mexico border region.

Racial and ethnic disparities in COVID-19 incidence are pronounced in underserved U.S./Mexico border communities. Working and living environments in these communities can lead to increased risk of COVID-19 infection and transmission, and this increased risk is exacerbated by lack of access to testing. As part of designing a community and culturally tailored COVID-19 testing program, we surveyed community members in the San Ysidro border region. The purpose of our study was to characterize knowledge, attitudes, and beliefs of prenatal patients, prenatal caregivers, and pediatric caregivers at a Federally Qualified Health Center (FHQC) in the San Ysidro region regarding perceived risk of COVID-19 infection and access to testing. A cross-sectional survey was used to collect information on experiences accessing COVID-19 testing and perceived risk of COVID-19 infection within San Ysidro between December 29, 2020 and April 2, 2021. A total of 179 surveys were analyzed. Most participants identified as female (85%) and as Mexican/Mexican American (75%). Over half (56%) were between the age of 25 and 34 years old. Perceived Risk: 37% reported moderate to high risk of COVID-19 infection, whereas 50% reported their risk low to none. Testing Experience: Approximately 68% reported previously being tested for COVID-19. Among those tested, 97% reported having very easy or easy access to testing. Reasons for not testing included limited appointment availability, cost, not feeling sick, and concern about risk of infection while at a testing facility. This study is an important first step to understand the COVID-19 risk perceptions and testing access among patients and community members living near the U.S./Mexico border in San Ysidro, California.

COVID-19 testing strategies that fail to incorporate culturally competent methods to reach traditionally underserved communities can lead to persistent transmission and increased infection rates. During the early stages of the COVID-19 pandemic, we surveyed 179 people living in a community with high burden of COVID-19 infection about their perception of infection risk and their experiences accessing testing. Capturing and understanding these community perceptions on COVID-19 risk are vital when developing a testing program that is accessible and appropriate for the target population. In our study, we found half of survey respondents thought their risk of COVID-19 infection as low to none and over half of respondents stated they had already been tested for COVID-19. These findings provide insight to the beliefs of individuals who live and seek health care in communities with high rates of COVID-19 infection and will help guide the design and implementation of culturally tailored testing strategies.

Enhancing review criteria for dissemination and implementation science grants.

BACKGROUND: The existing grant review criteria do not consider unique methods and priorities of Dissemination and Implementation Science (DIS). The ImplemeNtation and Improvement Science Proposals Evaluation CriTeria (INSPECT) scoring system includes 10 criteria based on Proctor et al.'s "ten key ingredients" and was developed to support the assessment of DIS research proposals. We describe how we adapted INSPECT and used it in combination with the NIH scoring system to evaluate pilot DIS study proposals through our DIS Center. METHODS: We adapted INSPECT to broaden considerations for diverse DIS settings and concepts (e.g., explicitly including dissemination and implementation methods). Five PhD-level researchers with intermediate to advanced DIS knowledge were trained to conduct reviews of seven grant applications using both the INSPECT and NIH criteria. The INSPECT overall scores range from 0 to 30 (higher scores are better), and the NIH overall scores range from 1 to 9 (lower scores are better). Each grant was independently reviewed by two reviewers, then discussed in a group meeting to compare the experiences using both criteria to evaluate the proposal and to finalize scoring decisions. A follow-up survey was sent to grant reviewers to solicit further reflections on each scoring criterion. RESULTS: Averaged across reviewers, the INSPECT overall scores ranged from 13 to 24, while the NIH overall scores ranged from 2 to 5. Reviewer reflections highlighted the unique value and utility for each scoring criterion. The NIH criteria had a broad scientific purview and were better suited to evaluate more effectiveness-focused and pre-implementation proposals not testing implementation strategies. The INSPECT criteria were easier to rate in terms of the quality of integrating DIS considerations into the proposal and to assess the potential for generalizability, real-world feasibility, and impact. Overall, reviewers noted that INSPECT was a helpful tool to guide DIS research proposal writing. CONCLUSIONS: We confirmed complementarity in using both scoring criteria in our pilot study grant proposal review and highlighted the utility of INSPECT as a potential DIS resource for training and capacity building. Possible refinements to INSPECT include more explicit reviewer guidance on assessing pre-implementation proposals, providing reviewers with the opportunity to submit written commentary with each numerical rating, and greater clarity on rating criteria with overlapping descriptions.